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Abstract 

Most  of  the  world's  computer  centers  use 
congruentlal  random  number  generators.  This  note 
points  out  that  such  random  number  generators  produce 
points  in  2,3,4,...  dimensions  which  are  too  regular 
for  many  Monte  Carlo  calculations.  The  trouble  is 
that  the  points  fall  exactly  on  a  lattice  with  quite 
a  gross  structure.  The  paper  gives  details  of  the 
degree  of  regularity  of  such  generators  in  terms  of 
sets  of  relatively  few  parallel  hyperplanes  which 
contain  all  of  the  points  produced  by  the  generator. 


Virtually  all  the  world's  computer  centers  use  an  arithmetic 
procedure  for  generating  random  numbers.  The  most  common  of  these 
is  the  multiplicative  congruential  generator  first  suggested  by 
D.  H.  Lehmer.  In  this  method,  one  merely  multiplies  the  current 
random  integer  I  by  a  constant  multiplier  K  and  keeps  the 
remainder  after  overflow: 

new  I  =  K  x  old  I  modulo  M. 

The  apparently  haphazard  way  in  which  successive  multiplications 
by  a  large  integer  K  produce  remainders  after  overflow  make  the 
resulting  numbers  work  surprisingly  well  for  many  Monte  Carlo  problems. 
Scores  of  papers  have  reported  favorably  on  cycle  length  and  statistical 
properties  of  such  generators. 

The  purpose  of  this  note  is  to  point  out  that  all  multiplicative 

congruential  random  number  generators  have  a  defect — a  defect  which 

makes  them  unsuitable  for  many  Monte  Carlo  problems,  and  a  defect 

which  cannot  be  removed  by  adjusting  the  starting  value,  multiplier, 

or  modulus.  The  problem  lies  in  the  "crystalline"  nature  of 

multiplicative  generators— if  n-tuples  (u,  ,u«, . « . ,u  ) , (u0 ,u, , .  . .  ,u  ,, ) , . . 

1  z  n  Li  n+i 

of  uniform  variates  produced  by  the  generator  are  viewed  as  points  in  the 
unit  cube  of  n  dimensions,  then  all  of  the  points  will  be  found  to  lie 
in  a  relatively  small  number  of  parallel  hyperplanes.  Furthermore, 
there  are  many  systems  of  parallel  hyperplanes  which  contain  all  of  the 
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points;  the  points  are  about  as  randomly  spaced  In  the  unit  n-cube 
as  the  atoms  In  a  perfect  crystal  at  absolute  zero. 

One  can  readily  think  of  Monte  Carlo  problems  where  such 
regularity  in  "random"  points  in  n-space  would  be  unsatisfactory; 
more  disturbing  is  the  possibility  that  for  the  past  20  years  such 
regularity  might  have  produced  bad,  but  unrecognized,  results  in 
Monte  Carlo  studies  which  have  used  multiplicative  generators. 

Some  notation:  For  any  modulus  m.  and  multiplier  k,  let 

rl,r2,r3’ *  “  ^  ^  <  m 

be  a  sequence  of  residues  of  m  generated  by  the  recurrence  relation 

ri+l  E  kri  ®odulo  m, 

and  let  u^Ug,^* . .  I  be  that  sequence  viewed  as  fractions  of  m: 

U1  "  r]/m*  u2  "  r2^m>  u3  “  r^/m,...  . 

Let  iT^  m  (u^,...,u^j,  n  2  m  ^2*  *  *  *  *^n+l^  ’  ^3  ™  (u^*  •  •  •  *^+2^  *  *  * '  ^6 

points  of  the  unit  n-cube  formed  from  n  successive  u's. 

Theorem.  If  c^,C2»...»c  is  any  choice  of  integers  such  that 

cn  +  c0k  +  c_k^  +•••+  c  kn  ^  =  0  modulo  m, 

12  3  n  ’ 

then  all  of  the  points  7r]_»7T2,‘’*  in  the  set  of  parallel 

hyperplanes  defined  by  the  equations 

c.x.  +  c-x_  +•••+  c  x  *  0,il,±2,...  . 

11  2  2  n  n 


There  are  at  most 
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of  these  hyperplanes  which  intersect  the  unit  n~cubet  and  there  is 
always  a  choice  of  such  that  all  of  the  points  fall 

in  fewer  than  (n!m)^n  hyperplanes. 

Here  is  a  table  of  (n!m)^n  for  the  most  common  values  of  m, 
powers  of  2: 

Upper  Bound  for  the  Number  of  Planes  Containing  All  n-tuples 


n=3 

n=4 

n*5 

n*6 

n-7 

n»8 

n-9 

n**10 

m=216 

73 

35 

23 

19 

16 

15 

14 

13 

n,=224 

465 

141 

72 

47 

36 

30 

26 

23 

„-232 

2953 

566 

220 

120 

80 

60 

48 

41 

*-235 

5907 

952 

333 

170 

108 

78 

61 

51 

m-236 

7442 

1133 

383 

191 

119 

85 

66 

54 

■n-248 

119086 

9065 

2021 

766 

391 

240 

167 

126 

32 

For  example,  in  a  binary  computer  with  32  bit  words,  m  ■  2  , 

fewer  than  41  hyperplanes  will  contain  all  10-tuples,  fewer  than 

566  hyperplanes  will  contain  all  4-tuples,  and  fewer  than  2953  plapes 

32 

will  contain  all  3-tuples.  (The  generator  r^+^  =  kr^  mod  2  will 
produce  357,913,941  independent  points  in  the  unit  3-cube  and 
theoretically,  the  smallest  number  of  planes  containing  all  these 

g 

points  is  about  10  ,  in  contrast  to  the  bound  of  2953.) 

The  theorem  can  be  proved  in  4  steps: 

Step  1.  If 

c,  +  cnk  +  c_k^  +  •••+  c  k.n  ^  =  0  modulo  m, 

12  3  n 
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then 

c.u.  +  c0u.,.  +•••+  c  u..  , 

1  i  2  i+1  n  i+n-1 

is  an  integer  for  every  i,  and  thus 

Step  2.  The  point  ir^  ■  ^ui,ui+l’ '  * '  ,ui+n-l^  must  ^ie  in  one 
of  the  hyperplanes 

clxl  +  C2X2  +**,+  cnXn  ”  0,±1,±2,±3, . . .  . 

Step  3.  The  number  of  hyperplanes.  of  the  above  type  which 

intersect  the  unit  n-cube,  0  <  x,  <  1, . . . ,0  <  x  <1  is  at  most 

1  r 

I c! I  +  lc2l  +**,+  lcnl’ 

and 


Step  4.  For  every  multiplier  k  and  modulus  m  there  is  a 

set  of  Integers  c, (not  all  zero)  such  that 
l  n 

c,  +  c0k  +  c,k^  +•••+  c  k11  ^  =  0  modulo  m 
l  z  j  n 

and 

IcJ  +  I  c2 1  +•••+  |cn|  1  (n!m)1/n. 

To  prov2  Step  1,  note  that  the  sequence  r^,^,...  can  be  put 
in  the  form,  using  the  greatest  integer  notation  [  ], 

2  2  3  3 

r^,  kr^-m[kr^/m] ,  k  r^-m[k  r^/m] ,  k  r^-m[k  r^/m],... 
and  thus  the  sequence  u^,^,...  may  be  written 
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ill  iii. 

U 

J* 

l _ 

k2ri 
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H 
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<N 
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’  m 

L  m  J 

*  m 
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Clearly,  if  +  Cjk  +•••+  c^k11  ^  is  a  multiple  of  m,  then 

c,u,  +•••+  c  u.  .  .  will  be  an  integer. 

1  i  n  i+n-1  ° 

Step  2  follows  immediately  from  Step  1,  and  Step  3  is  easily 
verified. 

Now  for  Step  4.  We  want  to  prove  that  there  are  integers 

c-,cof...,c  not  all  zero  such  that 
12  n 

c,  +  c„k  +  c_k2  +•••  +  c  kn  ^  =  0  modulo  m  (1) 

i  2.  j  n 

and 

|cjJ  +  |  c2 1  +•••  +  |cj  <_  (n!m)^n. 


To  do  this  we  transform  the  problem  so  that  it  becomes  a  standard  one 
in  the  geometry  of  numbers:  every  solution  to  (1)  can  be  expressed 
(uniquely)  by  the  relation 


(c. i • •  •  |C  )  =  (t t  ) 
lnln 


0  0  ••• 

0  0  •  •  • 

1  0  ••• 


0 

0 

0 


0  0  0  •••  -k 


where  the  t’s  are  integers.  Thus  the  problem  is  to  show  there  are 
integers  t.,.r.,t  not  all  zero  such  that 
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This  follows  from  a  general  theorem  on  linear  forms  by  Minkowski,  using 
the  basic  result  that  a  symmetric,  convex  set  of  volume  2n  in  n-space 
must  contain  a  point  (other  than  the  origin)  with  integral  coordinates. 
Elegant,  elementary  proofs  are  now  available;  see,  e.g..  Hardy  and  Wright", 
p.  394-396,  p.  413  or  Cassels1,  p.  150-153. 

Step  4  together  with  the  steps  1-3  complete  the  proof  of  Theorem  1 — 
every  multiplicative  random  number  generator  produces  n-tuples  of  uniform 
variates  which  lie  in  at  most  (n.'m)^n  parallel  hyperplanes.  Furthermore, 
any  choice  of  c^,...,c  which  satisfies  congruence  (1)  will  provide  a  set 
of  at  most  | c^ |  +  •••+  | cj  parallel  hyperplanes  which  contain  all  of  the 
n-tuples  produced  by  the  generator.  Similar  results  can  be  established  for 
congruential  generators  of  the  type  r^+^  kr^+c  mod  m. 


*  Cassels,  J.  W.  S.,  An  Introduction  to  Picphcr.tine  Approximation, 

Cambridge,  1965. 

2Hardy,  G.  H.  and  Wright,  E.  M. ,  An  Introduction  to  the  Theory  of  Numbers, 

4th  Edition,  Oxford,  1960. 


